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© Prioritizlzed image transmission system and method. 



© A system and method for processirtg and trans- 
mitting video imagery. The system permits the oper- 
ator of a video image system to selectively transmit 
desired portions of the video image at an operator 
selected resolution, operator selected compression 
level, and operator selected order of transmission of 
each of the portions. The system also includes a 
novel method of retransmitting only those packets of 
data which have been erroneously transmitted and 
an automated retransmission protocol which retrans- 



mits data in a more robust manner where errors are 
detected in the first transmission of the data. Also 
disclosed in the system is a method of shading 
various portions of the video image to inform the 
system operator of which portions of the video im- 
age have been transmitted and a protocol for limiting 
the duration of and for altering the frequency of data 
transmissions to avoid detection and/or jamming by 
others. 
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BACKGROUND OF THE INVENTION 



The present invention relates generally to digi- 
tal data processing and transmission techniques, 
and particularly to systems and methods for trans- 
mitting digital video images within limited band- 
widths. 

Presently, there are many systems in which 
video images are transmitted by means of elec- 
trical or electromagnetic signals. Examples of such 
transmitted video images are television, electronic 
photographs, facsimiles, video mapping, etc. Par- 
ticularly when color video images are to be trans- 
mitted, the transmission system generally requires 
considerable bandwidth for the signal. While large 
bandwidth systems, such as a typical television 
transmission system, can often adequately transmit 
a video signal, a considerable amount of bandwidth 
is required, and the transmitting and receiving 
equipment must be relatively complex and expen- 
sive to process large bandwidth signals. Addition- 
ally, in military applications, large bandwidth trans- 
missions ar& more readily detected and. therefore, 
more susceptible to jamming than more narrow 
band signals. 

In many video image systems, a video image 
to be transmitted is divided into an array of picture 
elements or pixels. Each pixel represents the video 
image at one small point of the pixel array. In some 
systems, a pixel may be represented by a single 
digital bit, either a zero or a one, indicating either 
the presence or absence of white in the portion of 
the image represented by the pixel. In more so- 
phisticated systems, each pixel is represented by 
plural digital bits which permit each pixel to have 
more than binary values of zero and one. For 
example, rf four bits are used to represent a pixel 
then the pixel may have up to sixteen different 
values, generally ranging from white to black. Each 
increment from one to sixteen in the binary digits 
often represents a darker or lighter shade of gray 
transitioning from white to black. Finally, in color 
systems, each pixel may be represented by three 
sets of plural digital bits, each of the plural digital 
bits of a set representing the amount of one of the 
primary colors (red, blue or green) present at the 
portion of the visual image represented by the 
pixel. Such a scheme is often utilized in digitizing 
television images. 

A standard broadcast color television picture 
may be adequately digitized into an image 768 
pixels wide and 488 pixels high with each pixel 
having a depth of 24 bits (8 bits each of red, blue 
and green). Each screen image then contains ap- 
proximately 375,000 pixels or approximately 9 mil- 
lion bits of digital data. While such large amounts 
of data can readily be sent by large bandwidth 
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transmission and receiving equipment, it is often 
desired to send such digital video images by less 
expensive and more readily available low speed 
equipment such as HF (high frequency) radio and 
5 telephone voice lines. Such low speed devices 
typically operate at anywhere from 1200 to 9600 
bits per second. If a single digital television image 
is sent via such a low speed transmission link, for 
example, a 2400 bps link, approximately 65 min- 
10 utes would be needed to send a single image. In a 
tactical military situation, a transmission of such 
duration is usually desired to be avoided as such a 
long duration transmission could readily be de- 
tected and jammed. Moreover, such a long trans- 
75 mission time for each image would permit only a 
single image to be sent per hour. 

Many of the known video image transmission 
systems transmit an entire screen of data. Often, 
however, only certain portions of the screen are of 
20 interest to the recipient of a signal and some por- 
tions of the image may be of more importance than 
others. In most known video signal transmission 
systems, no provision is made for transmission of 
only a selective portion of the video image or for 
25 transmission of different portions of the image at 
-different resolutions. 

While visual images in the form of television 
signals may be transmitted quite accurately by 
VHF equipment, VHF transmissions are generally 
30 limited to the line of sight between the transmitter 
and the receiver. Consequently, it is often desired 
to send television and other video image signals at 
other than VHF frequencies. For example, the use 
of signal carriers in the high frequency ("HF") 
35 range. Le„ 3,000 to 30.000 KHz. often permits 
worldwide communication between transmitter and 
receiver as the HF signal can be bounced or re- 
flected off the ionosphere and back to earth. Con- 
ventional HF systems do not have sufficient band- 
40 width to send real time television signals, however. 

ft is accordingly an object of the present inven- 
tion to provide a novel video image system and 
method whereby digital video images may be 
transmitted worldwide and/or through relatively low 
45 bandwidth transmission media. 

It is a further object of the present invention to 
provide a novel system and method for video im- 
age transmission whereby selected portions of a 
video image may be transmitted to a receiver, 
so It is yet another object of the present invention 

to provide a novel video image system and method 
in which the resolution of the image to be transmit- 
ted may be controlled by the operator of the video 
system in accordance with the operator's interest in 
the contents of the video image. 

2 



EP 0 402 954 A2 



It is still a further object of the present inven- 
tion to provide a novel system and method of video 
image transmission whereby the portion of the im- 
age of most interest to the user is transmitted first. 

It is still another object of the present invention 
to provide a novel video image system and method 
in which the operator of a video transmission sys- 
tem is made aware of the progress of the transmis- 
sion of video image data. 

It is still yet another object of the present 
invention to provide "a novel video image system 
and method in which the time during which trans- 
mission takes place is limited to relatively small 
bursts and in which successive transmissions may 
be made at different transmission frequencies. 

These and many other objects and advantages 
of the present invention will be apparent from the 
claims and from the detailed description of the 
preferred embodiments when read in conjunction 
with the appended drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a functional block diagram of a 
video processing and transmission system which 
may use the system and method of the present 
invention; 

Figure 2 is a flow diagram of one embodi- 
ment of the system and method of the present 
invention which may be utilized in the video image 
processing system of Figure 1 ; 

Figure 3A-3D are diagrammatic 'illustrations 
of the operation of the system of Figure 2; 

Figure 4 is a diagram of a digital, storage 
map of a video image illustrating methods of vary- 
ing pictorial resolution in the system of Figure 2. 

Figure 5 is a pictorial diagram of a block of 
video data to be transmitted in a system of Figure 
2, illustrating varying levels of compression. 

Figure 6 is a diagrammatic illustration of the 
format of a data packet which may be utilized in 
the system of Figure 2; 

Figure 7 is a diagrammatic illustration of the 
format of an ACK/NAK message which may be 
utilized in the system of Figure 2. 

Figure 8 is a functional block diagram of an 
embodiment of a transmitting unit of the present 
invention. 

Figure 9 is a functional block diagram of an 
embodiment of a receiver unit of the present inven- 
tion. 

Figure 10 is a functional block diagram of an 
intelligence gathering system which utilizes the 
system of the present invention; 

Figure 11 is a flow diagram of a method of 
transmitting data which may be utilized by the 



system of Figure 2; and 

Figure 12 is a flow diagram of a method of 
receiving data which may be utilized by the system 
of Figure 2. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



io With reference to Figure 1, a video input de- 

vice 1 0 may receive or generate a video signal in a 
conventional analog signal format in correspon- 
dence to a sensed visual image. The signal may 
be color encoded. 

75 The analog signal from the video input device 

10 may be digitized by a digitizer 12 which periodi- 
cally produces a digital signal related to the gray 
level and/or the color of the video input signal. The 
digital signals produced by the digitizer 12 may be 

20 stored in a storage device 14 in an array which has 
reference to the position of each of the digital 
signals within the image being provided by the 
video input device 10. Accordingly, each of the 
digital signals may be considered a picture ele- 

25 ment, or pixel, relating the video image seen by the 
video input device 10 to a particular position within 
the entire video image and the digital storage array 
may be considered a digital map of the visual 
image. In a standard television signal, for example, 

30 the video input signal is often stored in an array 
which has 768 pixels horizontally and 488 pixels 
vertically. However, the exact number of pixels into 
which a visual image is divided is not significant to 
the present invention. 

35 The pixels may be related to the gray level of 

the visual image, how white or how black the image 
is, and/or it may be related to the color of the 
image, Le., how much of the colors red, green, and 
blue are detected by the detectors within the video 

40 input device 10. 

* Once the pixels are stored in the storage de- 
vice 14, they may be acted upon by the 
control/processing unit 16 which is controlled by a 
keyboard 18. The video signal represented by the 

45 stored pixels, 'available to the control/processing 
unit 16, may be displayed in a monitor 20. Upon 
command by the operator of the control/processing 
unit 16, a signal which contains all or a portion of 
the visual image stored in the storage device 14 

so may be sent to a transmitter 22 to be transmitted 
to a remote device via a transmitter antenna 24. 
When the transmitted signal is received at a re- 
ceiver antenna 30, it may be sent to a receiver 32 
which removes any carrier signal or the like which 

55 may have been used during the transmission and 
provides the visual image signal to the receiver 
control/processing unit 34 which is, in turn, con- 
trolled by a keyboard 36, on which commands may 
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be entered by the operator of the receiver portion 
of the system. Upon the command of the operator, 
the receiver control/processing unit 34 may provide 
the visual signal to the display unit 38. 

The video input device 10 may be any conven- 
tional video input unit such as a black-and-white 
television camera, a color television camera, a fac- 
simile machine, an optical scanner, or similar de- 
vice which converts visual or optical imagery into 
an electrical or electromagnetic signal. The storage 
device 14 and control/processing unit 16 and 34 
may be conventional computer or personal com- 
puter storage and control systems. The display 
monitors 20 and 38 may be conventional television 
monitors (black-and-white, monochrome, or color) 
or similar devices on which a visual image may be 
obtained from electronic signals. 

The control/processing unit 16 provides the 
visual image data to the transmitter 22 which may 
transmit the data in a conventional format or in the 
novel format described hereinbelow. The receiver 
control/processing unit 34 and associated keyboard 
36 may also be a conventional computer or per- 
sona! computer and may include a volatile memory 
to temporarily hold visual image data and/or per- 
manent storage device such as magnetic disks to 
save, for a longer term, selected desired visual 
images. 

With reference to Rgure 1 and additional refer- 
ence to Rgure 2, the visual image transmission 
and processing system and method of the present 
invention may utilize the steps depicted in the flow 
diagram of Rgure 2. At the start of the sequence, a 
visual image frame is captured by the video input 
device 10 and digitized through, for example, an 
analog-to-digital signal converter and placed into 
digital storage. The frame of visual data which has 
been stored may be a high resolution still-frame 
color image with the storage representing individual 
pixels of the image. 

With continued reference to Rgures 1 and 2, 
by controlling the keyboard 18. the user may 
specify one or more portions of the visual video 
image to transmit, or select to transmit the entire 
image. The video image may be divided into con- 
veniently sized blocks of data for ease of selection 
and manipulation. The operator of the system may 
select the resolution, compression level, and order 
of transmission (in the event more than one portion 
is desired to be sent) for each portion (i.e., a group 
of blocks) of the image which he desires to trans- 
mit After the operator selects the one or more 
portions to be transmitted the control/processing 
unit 16 obtains the digital data from the storage 
unit 14 which correspond to the selected portions 
of the image. The digital data corresponding to the 
portions may then be processed by the 
control/processing 16 unit to reduce the resolution 



and to compress the image if such has been se- 
lected by the operator. The digital data correspond- 
ing to the selected portions may then be loaded 
into communication packets which may be pro- 
5 vided. in the order selected by the operator, to the 
transmitter for transmission to the receiver portion 
of the system. When the transmission of the digital 
data corresponding to the selected portions of the 
image is complete, the transmitting portion of the 

io system awaits an acknowledgment message (an 
"ACK/NAK" message) from the receiving portion of 
the system. The ACK/NAK message informs the 
transmitter portion of the system whether each 
block of data was correctly or incorrectly received 

75 by the receiver 32. In the event a block was in- 
correctly received, the message includes a request 
that the transmitter resend only the incorrectly re- 
ceived packets in the specified blocks of data. The 
transmitter may then resend the selected packets 

20 until all of the selected packets have been resent 
or until the receiver sends an abort message halt- 
ing the retransmission of the data. 

A method by which the operator of the trans- 
mitter portion of the system may select which 

25 portions of the visual image to transmit is illustrated 
in Rgures 3A-3D. With reference to Figure 3A, a 
visual image may have portions which are of more 
interest to the operator of the system than other 
portions of the image. At the command of the 

30 operator, the control/processing unit 16 may dis- 
play on the monitor 20 the visual image as de- 
picted in Rgure 3A. Upon a further command of 
the operator, the control/processing unit 16 may 
provide a grid overlay on the visual image of Rg- 

35 ure 3A to produce the overlay image shown in 
Rgure 3B. Through use of conventional input de- 
vices such as a keyboard 18, or mouse, etc., the 
operator of the system may then specffy a specific 
block or specific location within the grid which is of 

40 particular interest to the operator for transmission. 
The block or location is herein called the "interest 
center" and will normally be transmitted first by the 
control/processing unit 16. 

With continued reference to Rgure 3B, the plus 

45 sign (" + ") indicates the block which the operator 
has selected as his interest center in this example. 
Once the interest center has been selected, the 
operator may then specify the entire portion of the 
image which is to be sent in association with the 

so specified interest center, i.e., the operator may 
specify the "borders** of the portion to be transmit- 
ted. As shown in Rgure 3C. the operator may, for 
example, select a square portion of the image 
which best illustrates the "man" and nearby back- 

55 ground depicted in the visual image. To assist the 
operator in selecting the portion of the screen, the 
control/processing unft 16 may construct overlays 
on the screen which define for the operator what 
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portions of the screen he has selected. Such defini- 
tion could be provided by shading the visual image 
with particular colors or particular hues to indicate 
the selected portion. With reference to the visual 
image of the man shown in Figure 3C, the code W s 
indicates the portion of the. visual image which has 
been selected by the operator for transmission. 

With continued reference to Figures 3B and 
3C. the operator may continue to select other por- 
tions of the visual image such as the selection of jo 
the "vehicle" illustrated in Figures 3B and 3C. The 
code "B" in Figure 3C indicates the portion of the 
visual image which has been selected by the oper- 
ator to send the interest center related to the 
vehicle. rs 

As a part of selecting the interest center and 
portions of the visual image to be transmitted, the 
system of the. present invention permits the oper- 
ator to specify both the resolution and compression 
to be used in transmitting each of the portions of 20 
the visual image. To remind the operator what 
portions of the visual image have been selected 
and what resolution and compression levels have 
been selected, the system of the present invention 
may key the shading which is used on the monitor 25 
to specify the portion to be transmitted in a 
scheme known to the operator. 

With reference to Figure 3D, the selected por- 
tion of the visual image around the "man" of Figure 
3A is illustrated in greater detail. Each of the blocks 30 
of the visual image has been numbered for pur- 
poses of explanation from one to nine. In the sys- 
tem of the present invention, the data may be sent 
in blocks of a predetermined size, for example, 64 
pixels by 64 pixels. The block which the operator 35 
has specified is the interest center (labeled "1 " in 
Figure 3D) may be sent first and then the blocks 
adjacent to the interest center may be sent. The 
process may be continued radially outwardly, such 
as in a spiral fashion, until all blocks of the selected 40 
portion of the picture have been transmitted. In the 
example shown in Figure 3D, the blocks may be 
sent in the order of their illustrative numbering, 1, 
2, 3,„.9. By the use of this procedure, the portion 
of the visual image which the operator has deter- 45 
mined to be the most significant is sent first. As 
each block is transmitted it may be shaded to 
indicate that it has been transmitted. When the 
receiver is receiving the visual image, the operator 
of the receiver may determine that partially through 50 
the transmission he has received sufficient data 
and command the system to go to the next interest 
center. In this way, transmission time is kept to a 
minimum and the information of most importance is 
transmitted with priority. Similarly, the operator of 55 
the transmitter may command the system to go to 
the next interest center partially through a transmis- 
sion. 
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When the operator of the system of the present 
invention selects more than one portion of an im- 
age (which may be unrelated and on noncpnnec- 
ting portions of the screen), the operator also se- 
lects which image portion will be transmitted first, 
second third, etc. Once this selection process is 
made, the control/processing unit may transmit 
each selected image portion from the interest cen- 
ter of the image out to the selected border of each 
image portion. This process continues until all se- 
lected image portions are completely transmitted or 
until the transmission is otherwise ended. 

In the system of the present invention, the 
operator can specify which of a large number of 
resolution techniques and levels should be utilized 
depending upon the transmission protocol, the 
noise levels on the transmission channels, and the 
images being transmitted. 

With reference to Figure 4, one method of 
varying the resolution in a system of the present 
invention may be illustrated in the digital storage 
map depicted in Figure 4. A system of the present 
invention may digitize the input video signal into a 
video map having 2,048 pixels in both the horizon- 
tal and vertical directions, as partially illustrated in 
the visual map of Figure 4. The numbers within 
each of the cells of Figure 4 represent the serial 
position of the pixel within the storage map, it 
being understood that at each of the numbered 
locations of the storage map, (i.e., cells) the digital 
value associated with a particular pixel is stored. 
To transmit a digital image at full resolution, the 
pixels from each of the storage map locations may 
be transmitted in turn. Such a procedure ensures 
that all granularity of the digital data is retained, 
however at a cost of sending a very large block of 
data. For example, In the 2048 x 2048 system 
illustrated in Figure 4, approximately 4.2 million 
pixels would be transmitted. 

To reduce the transmission time, various meth- 
ods may be utilized to either combine the data in a 
predetermined manner or to not transmit certain 
portions of the data. When the combined data is 
received at the receiver portion of the system, the 
receiver control/processing unit constructs the im- 
age based upon the received data and the resolu- 
tion technique used prior to transmission. For ex- 
ample, a simple method would be merely to trans- 
mit every other pixel, i.e., transmitting pixels 1, 3, 

5, 7, 9, ... 2049, 2051~ . 8193 Alternatively, 

groups of pixels could be combined in a type of 
averaging. For example, pixels 1 , 2, 3, and 4 could 
be averaged and the average value of the pixel 
transmitted, for a 75%' reduction in number of 
pixels which need to be transmitted. Similarly, pix- 
els 6145. 6146, 6147. and 6148 and 8197, 8198. 
8199. and 8200 may be combined and a single 
"representative" pixel value transmitted. Obviously. 
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many different schemes can be used to attempt to 
reduce the number of pixels which are transmitted 
and yet maintain picture granularity as high as 
possible, including averaging in both the horizontal 
and vertical directions, etc. 

In addition to techniques which reduce the res- 
olution of the data and correspondingly reduce the 
amount of data which need to be transmitted, the 
system of the present invention also enables the 
operator to select varying levels of compression of 
the data, such as normal Hoffman encoded, or 
various ratios of subsampled data. The data may 
be compressed in any conventional data compres- 
sion technique. 

The following is illustrative of the types of 
compression techniques which may be utilized to 
further reduce the amount of data which must be 
transmitted. With reference to Figure 5, assume 
that the numbers shown in the block of the top of 
the figure represent the digital value of a series of 
pixels to be transmitted. A review of the values of 
the pixels shows that in the middle of the series of 
pixels, the values of the pixels are fairly close to 
each other. This is not an uncommon occurrence in 
visual images as most images have many large 
portions in which the color does not change signifi- 
cantly portions of the image, re., the sky may be a 
fairly constant color across the top of an outdoor 
scene. Rather than transmit small changes in the 
value of the pixels, a coding scheme may be used 
such that if adjacent pixels do not change by more 
than a prespectfied amount, the subsequent pixels 
are not sent but a multiplier is indicated in associ- 
ation with a determined pixel value. 

For example, with reference to the pixel values 
in Figure 5, if no compression is utilized, the data 
which is transmitted is shown in the first row of the 
"Data Transmitted" table and it corresponds to the 
value of each of the pixels. Compression can be 
selected to be narrow, moderate or full or variations 
thereof depending on the granularity of the picture 
which the operator is willing to accept ff, for exam- 
ple, a narrow compression is specified, only pixels 
having values very close to each are combined. In 
the pixel series of Figure 5, the middle pixels al! 
have the value of 97. Accordingly, the data which is 
transmitted may include a special character, for 
example the asterisk of line A of Figure 5 and a 
multiplier, Le., the numeral 3 before the asterisk, to 
indicate to the receiving system that the next three 
pixels are all 97. even though only one of the pixels 
is being transmitted. 

If a moderate compression is selected, for ex- 
ample, pixels having a value within a particular 
range of each other, Le„ within five units, for exam- 
ple, may all be compressed into a single unit which 
is the average of the selected pixels. The 
"average" pixel is transmitted along with a multi- 



plier to indicate the number of consecutive pixels 
represented by the "average". In the data se- 
quence depicted in Figure 5, the pixels having a 
value of 95, 97, 97, 97, 93, all appear in sequence 
s and are within five units of each other and therefore 
may be compressed into a single unit having the 
average value of 96 and a multiplier character 
indicating five pixels of that value (as shown on line 
B). 

w In the final line (°C n ) of Figure 5 is exemplified 

a more severe compression in which all adjacent 
pixels having values within eight of each other may 
be compressed. Note that at the transmission of 
line C, the number of digital numbers which must 

is be actually transmitted is about half as many when 
compared to a no compression transmission. How- 
ever, some granularity of the picture has been lost 
as an average value of 93 units is transmitted 
instead of the actual values which vary from 89 to 

20 97 units. Using combinations of resolution seduc- 
tion and compression techniques, visual images 
have been successfully communicated by the 
transmission of only five percent of the digital video 
data. 

25 The foregoing is only illustrative of the many 

different kinds of compression techniques which 
can be utilized. Such other compression tech- 
niques may not be restricted merely to adjacent 
horizontal pixels but may take into account both 

30 horizontal and vertical proximity of the image re- 
presented by the pixels. Again, in the system of 
the present invention, the operator is able to select 
a compression level prior to transmission so that 
data is transmitted for a minimal amount of time. 

35 In operation, the present invention may use two 

message types: data packets for transmitting im- 
age data, and ACK/NAK messages sent from the 
receiver of the image data to the transmitter in- 
dicating which data packets were incorrectly trans- 

40 mitted. 

With reference now to Figure 6, a data packet 
may include a header with administrative informa- 
tion, the image data, a check sum, and framing 
characters. The length of each segments may be 

45 any appropriate number of bits, with number of bits 
per segment shown In Figure 6 being exemplary. 

The header may take various forms and may 
include a block Identifier, a packet identifier, an" 
indicator of packet type and an indicator of the 

so type of compression and/or resolution used. The 
block identifier may identify the block by pixels or 
may include control information, such as a signal 
indicating that text is to be sent, transmitting station 
identifier, total number of data blocks to be sent, 

55 etc. The packet identifier may be a vector pinpoint- 
ing the location of the image data within the iden- 
tified block, tn addition to indicating that the data 
packet is a standard type, the packet type indicator 
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may be used to signal such events as the first or 
last packets in a block, a packet of unusual size, a 
transmission abort, etc. The indicator of compres- 
sion type may include codes identifying the level 
and type of compression in the transmitted data. 

Image data may be loaded sequentially into 
data pockets and then transmitted block-by-block. 
The amount of image data per packet may be 
variable with a predetermined maximum, such as 
512 bits. For example, where 8 bits are required to 
describe a pixel, 64 pixels might be described in 
one data packet; in a data block 64 pixels on a 
side, 64 such data packets would be used to de- 
scribe a complete data block; a screen 512 pixels 
on a side would be divided into 64 such data 
blocks, with 4,096 data pakets describing the 
screen (of course, careful selection of blocks for 
transmission and data compression would reduce 
the number of data packets needed to adequately 
describe a portion of the screen). In the event that 
the last pieces of image data for a particular data 
block are loaded before a data packet is com- 
pletely filled only 256 of 512 bits filled), data 
from the subsequent block may be added to the 
data packet following an abbreviated header. 

The check sum segment of the data packet 
allows the receiver to detect errors in the transmit- 
ted data packet. Any known data integrity assur- 
ance technique may be used, although the cyclic 
redundancy check sum (CRC) is preferred. The 
framing characters may be used to locate a packet. 

The ACK/NAK message is a packet status re- 
port. If all packets from a block were correctly 
transmitted the ACK/NAK message may include 
only a brief indication of that event If, on the other 
hand, one or more packets within a block were 
incorrectly transmitted (e.g ., the check sum didn't 
match, the packet was missing or did not have a 
check sum), the ACK/NAK message may include 
the identifier of each packet incorrectly transmitted. 
The ACK/NAK message may also include a check 
sum and framing characters. The message format 
illustrated in Figure 7 is exemplary. 

In the event the transmitter receives the 
ACK/NAK message that indicates one or more data 
packets were incorrectly transmitted, the data from 
the specified packets may be retransmitted in 
smaller packets. For example, four packets contain- 
ing 128 bits of image data each may be transmit- 
ted to correct one 512-bit packet. 

To increase the li kit hood that a data packet is 
transmitted correctly, the packet may be repeated, 
with the number of repetitions being based on an 
operator-selected transmission condition. For ex- 
ample, in optimal transmission conditions, a data 
packet being retransmitted in response to an 
ACK/NAK message might be retransmitted twice, 
while in degraded transmission conditions it might 



be retransmitted four times. In the system of the 
present invention, the operator of the receiver may 
override this automatic retransmission if the oper- 
ator is satisfied with the quality of the received 
s image. 

This error elimination process can continue un- 
til the image is totally correct, until it is manually 
aborted, or until a predetermined number of cycles 
has been achieved. Because the receiving operator 

to may cancel the retransmission of bad blocks, the 
system helps to avoid detection in a military envi- 
ronment by reducing the amount of time during 
which the messages must be transmitted. 

As the images or portions of images are being 

?5 sent from the transmitting terminal to the receiving 
terminal, the data blocks which are being and have 
been sent may be shaded, highlighted, or boxed 
on the transmitting unit's monitor for the informa- 
tion of the operator. This technique provides a 

20 visual que to the unit operator to decide when the 
abort or stop a transmission of an image. 

The operation of an embodiment of the present 
invention may be seen with reference to Figures 8 
(transmitter unit) and 9 (receiving unit). The opera- 

25 tion of the transmitting unit may begin with the 
.operator's selection of the data blocks to be trans- 
mitted. The image data from the selected blocks 
may be loaded into packets in a block handling 
unit. A communications unit operates a modem and 

30 transmits the data packets, in the event an 
ACK/NAK message is received requesting retrans- 
mission of selected packets, the operator may stop 
the retransmission after a predetermined number of 
retransmission requests (a parameter set by the 

35 operator) to avoid prolonged periods of transmis- 
sion. Data from incorrectly transmitted packets may 
be reloaded into smaller packets and retransmitted. 
When the transmission of image data is complete 
and all errors resolved, the image data may be 

4o discarded. 

The operation of the receiving unit illustrated in 
Figure 9 may begin with detection of a transmitted 
signal and identification of a packet with a good 
check sum. A packet handler may identify the type 

45 of packet (e.g., image data, text for screen, other 
message, header control information) and allocate 
the information appropriately. When the transmis- 
sion is completely received, the ACK/NAK mes- 
sage may be built and transmitted. The operator of 

so the receiver unit may set a limit on the number of 
allowed retransmissions to reduce the length of the 
transmissions. 

With reference to Rgure 10, the video image 
processing and transmission system may be em- 

55 bodied in an intelligence system in which an intel- 
ligence source operates a video imagery device 
such as a video camera 100. The operation of the 
video camera Is monitored by a display device 102 
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accessible to the operator of the intelligence 
source. The signal obtained from the video camera 
may be transmitted through a conventional VHF 
transmission system to a line of sight receiver. 
Such a system is readily adaptable to military 
aircraft to which a high resolution television camera 
is attached and utilized for reconnaissance pur- 
poses. 

Because the intelligence source may not be 
within line of sight distance of the desired recipient 
of the visual information, the VHF transmission may 
be received by a retransmission station located 
within the fine of sight of the intelligence source. 
Upon receipt of the transmission the VHF by re- 
ceiver 106, the signal is applied to the retransmis- 
sion control station 108 which contains the digitizer, 
storage unit and control/processing unit of the 
present invention. When the retransmission control 
operator has determined which portions of the re- 
ceived signal to retransmit to the headquarters, the 
selected digital video signals are sent, as de- 
scribed above, through a modem to a high fre- 
quency transmission unit 114. Because the signal 
being sent by the retransmission station is sent 
with a high frequency, the signal may be sent far 
beyond the line of sight distance. When received 
by HF receiver 116 at the headquarters' unit, the 
signal may be demodulated by the modem 120 
and displayed on a monitor 124, or hard copy 
production device 126 under control of the receiv- 
ing control/processing unit 122. In a specific em- 
bodiment, many remote intelligent sources can be 
each transmitting to plural retransmission stations 
which in turn are each retransmitting the -selected 
video signals to the headquarters location. In this 
way, a field commander can obtain visual imagery 
of various aspects of a military deployment in nu- 
merous remote locations in near real time. 

The system of the present invention may be 
used in a wide variety of visual communication 
systems, particularly (although not necessarily) 
when some portions of the communication system 
are not within the line-of-sight of other portions. 
One of the advantages of a system of the present 
invention is the ability to use relatively narrow- 
bandwidth communication devices (such as tele- 
phone lines, HF radio links, optical cable, etc.) in 
the transmission of visual imagery without the con- 
sumption of inordinate periods of time. The adapt- 
ability of the selective image portion transmission 
method generally reduces the amount of time 
needed to transmit visual images of interest and 
reduces the need to transmit detailed imagery of 
little concern to the user in order to obtain detailed 
imagery of great concern to the user. 

The system of the present invention may read- 
ily be utilized within the large, existing network of 
tow speed communications, such as the vast tele- 



phone systems and within the bandwidth limits of 
existing communications equipment such as 
modems and HF radio links. 

Whenever it is desired to avoid eavesdropping, 
5 or in military environments to avoid detection 
and/or jamming, it is often desired to limit the 
amount of time during which a system is actively 
broadcasting. In a system of the present invention, 
detection and jamming may be avoided by break- 
to ing the message blocks into smaller units or pack- 
ets, and transmitting each packet at a differing 
frequency after a random delay lime between the 
transmission of successive packets. In a system of 
the present invention, the transmitting unit may 
75 initiate the transmission of a visual image by trans- 
mitting a portion of the image as well as set of 
control .data to the receiving terminal. The control 
data includes the time of the next transmission, the 
length of the next transmission (or image) and the 
20 transmitting frequency of the next transmission. At 
the conclusion of the transmission of the message, 
the control data may include a reply frequency and 
time. By examining the control data, the receiver 
can be automatically set to transfer to the assigned 
25 frequency at the predetermined time to receive the 
next portion of the image. 

Wrth reference to Figure n. a transmitting unit 
in the system of the present invention may utilize 
the method depicted in the flow diagram of Figure 
30 11. When the transmitting unit determines to trans- 
mit a message, the message is generally divided 
into multiple blocks of data . The first block of data 
is transmitted to the receiving unit on a previously 
specified frequency. If more blocks are to be sent, 
35 the transmission unit also sends a rendezvous time 
and frequency to the receiving units. While waiting 
for the determined rendezvous time, the transmit- 
ting unit may change to the rendezvous frequency 
so that it is prepared to transmit immediately upon 
40 the arrival of the rendezvous time. The transmis- 
sion of messages at different rendezvous times and 
frequencies is continued until all of the message is 
sent at which time the transmitting unit in place of 
the rendezvous time and frequency, includes a 
45 reply time and frequency in its message to the 
receiving unit. Upon transmitting the reply time and 
frequency data, the transmitting units returns to the 
reply frequency and waits for the reply, which will 
identify bad blocks which are to be resent, if any. If 
so a reply is received, the transmitting unit becomes 
the receiving unit and may use the receiving meth- 
od illustrated in Figure 12. below. 

With reference to Figure 12, the receiving unit 
upon reception of a portion of a message captures 
65 the portion of the message until the end of the 
message. Upon receiving the message portion, the 
message portion is checked to determine whether 
a rendezvous frequency and time have been in- 
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eluded, If a rendezvous frequency and time have 
been included, the receiving units retimes its radio 
to the rendezvous frequency, and waits the amount 
of time until the rendezvous is scheduled at which 
point it again receives data on the rendezvous 
frequency. At the completion of the message, the 
transmitting unit will have sent a reply frequency 
and rendezvous time to which the receiving unit 
may retune and, upon the expiration of the speci- 
fied time, transmit to the transmitting unit the iden- 
tification of bad blocks or packets that are to be 
resent. 

The present invention may be embodied in 
other specific forms without departing from the 
spirit or essential characteristics thereof. The pres- 
ently disclosed embodiments are therefore to be 
considered in all respects as illustrative and not 
restrictive, the scope of the invention being in- 
dicated , by the appended claims rather than by the 
foregoing description, and all changes which come 
within the meaning and range of the equivalency of 
the claims are therefore intended to be embraced 
therein. 



Claims 

1 . Method for transmitting one or more portions 
of a digital image comprising the steps of: 

(a) separating said digital image into blocks 
of digital data representing the image; 

(b) selecting one or more groups of said 
blocks to be transmitted; 

(c) selectively reducing the amount of digital 
data in said blocks to be transmitted; 

(d) designating the order of transmission of 
each of said groups; and 

(e) transmitting each of said groups respon- 
sive to said steps (b)-(d). 

2. The method as defined in Claim 1 further 
comprising the step of defining the first said block 
of digital data to be transmitted in each of said 
groups, and wherein said step of transmitting fur- 
ther comprises the steps of transmitting said first 
block first in each of said groups, and of transmit- 
ting the remaining of said blocks in each of said 
groups in order of proximity to said first block. 

3. The method as defined in Claim 1 wherein 
said step of transmitting further comprises the step 
of transmitting on a narrow band communications 
channel. 

4. Method for transmitting an image repre- 
sented by digital data comprising the steps of: 

(a) defining blocks to be transmitted, each of 
said blocks comprising digital data in packets re- 
presenting a portion of said image; 

(b) selectively establishing the order of trans- 
mission of said blocks; 



(c) selectively adjusting the amount of digital 
data in each of said blocks; and 

(d) transmitting said blocks responsive to 
steps {b) and (c). 

5 5. The method as defined in Claim 4 wherein 

said step of establishing the order of transmission 
further comprises the steps of designating a first of 
said blocks to be transmitted and designating the 
order of transmission of the other said blocks 

70 based on proximity to said first block. 

6. The method as define in Ciaim 4 further 
comprising the steps of indicating said blocks to be 
transmitted on a monitor and indicating completion 
of transmission of said blocks on said monitor. 

75 7. The method as defined in Claim 4 further 

comprising the steps of: 

(a) providing first check sums for said pack- 
ets of digital data to be transmitted; 

(b) transmitting said packets with corre- 
20 sponding said first check sums; 

(c) receiving said packets with said first 
check sums; 

(d) calculating second check sums for re- 
ceived said packets; 

25 (e) comparing corresponding said first and 

second check sums; 

(f) identifying said packets in which said first 
and second check sums are not the same; 

(g) retransmitting only identified ones of said 
30 packets after said blocks have been transmitted. 

8. A method for selectively transmitting one or 
more portions of a high resolution image depicted 
by digital data comprising the steps of. 

(a) establishing a matrix on said image of 
35 blocks containing digital data; 

(b) selecting one or more interest centers on 
said image, wherein each said interest center is 
one of said blocks representing a focal point of a 
portion of said Image to be transmitted; 

40 (c) selecting a group of said blocks proxi- 

mate to and including one said interest center, 
wherein each said group represents a portion of 
said image to be transmitted; 

(d) selectively reducing the amount of digital 
45 data in each of said blocks to be transmitted; . 

(e) selectively assigning an order of trans- 
mission for each said group; and 

(f) transmitting each said group, wherein said 
interest center is transmitted first in each said 

50 transmitted group and the remaining said blocks in 
each said transmitted group are transmitted in or- 
der of proximity to said interest center. 

9. The method as defined in Claim 8 wherein 
said step of transmitting further comprises the step 

55 of transmitting on a narrowband communication 
channel. 

10. A method of transmitting and receiving 
digital data representing an image comprising the 
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steps of: 

(a) defining blocks of said data representing 
portions of said image; 

(b) loading digital data from the defined 
blocks into packets of data to be transmitted; 

(c) providing first check sums for said pack- 
ets of data; 

(d) transmitting said packets of data and said 
first check sums; 

(e) receiving said packets of data and said 
check sums without acknowledging receipt until 
after said blocks are received; 

(f) calculating second check sums for re* 
ceived said packets of data; 

(g) comparing corresponding said first and 
second check sums; 

(h) identifying said blocks of data in which 
corresponding said first and second check sums 
are the same for each of said packets therein; 

(i) identifying said packets of data in which 
said first and second check sums are not the 
same; 

(j) retransmitting said packets of data iden- 
tified in step CO- 

11. The method as defined in Claim 10 further 
comprising the step of reloading digital data from 
each of said packets identified in step 0) into plural 
packets for retransmission. 

12. The method as defined in Claim 11 further 
comprising the step of retransmitting the reloaded 
plural packets plural times wherein the number of 
retransmissions is related to an operator-selected 
transmission condition. 

13. A method of transmitting and receiving a 
portion of a digital image comprising the steps of: 

(a) separating said digital image into blocks 
of digital data representing the image; 

(b) selecting a group of said blocks repre- 
senting the portion of the image to be transmitted; 

(c) selectively compressing the digital data 
in said group whereby the amount of digital data to 
be transmitted may be reduced; 

(d) loading the compressed digital data into 
packets; 

(e) transmitting said packets from a transmit- 
ting unit. 

(f) receiving said packets at a receiving unit; 

(g) determining at the receiving unit whether 
each received packet is correct; 

(h) transmitting a message from the receiv- 
ing unit indicating that all of the packets in one of 
said blocks were correctly received, when accurate; 

(i) transmitting a message from the receiving 
unit indicating that a specified one of the received 
packets is incorrect when accurate; 

0) retransmitting in plural packets from the 
transmitting unit the digital data in the received 
packet indicated to be incorrect 



14. A method of transmitting blocks of digital 
data representing a portion of a digital image com- 
prising the steps of: 

(a) loading said digital data from said blocks 
5 to be transmitted into packets; 

(b) transmitting said packets; 

(c) receiving said packets; 

(d) identifying the blocks having each of the 
packets therein correctly received; 

10 (e) identifying the packets that were incor- 

rectly received; 

<f) retransmitting the packets that were in- 
correctly received. 

15. A method of transmitting and receiving 
is digital data representing an image comprising the 

steps of: 

(a) defining one or more portions of said 
image to be transmitted; 

(b) transmitting a first random length part of 
20 a first portion of said image; 

(c) transmitting remaining random length 
parts of said first portion and of the other said 
portions at random intervals and on random fre- 
quencies; and 

25 (d) instructing a receiver to receive said oth- 

er portions at corresponding said intervals and said 
frequencies. 

16. A system for transmitting a portion of an 
image represented by digital data comprising: 

3 o (a) means for separating said image into 

blocks of digital data; 

(b) means for selecting for transmission one 
or more groups of said blocks; 

(c) means for selectively reducing the 
35 amount of digital data in each of said blocks; 

(d) means for designating the order of trans- 
mission of said groups; and 

<e) means for transmitting said groups. 

17. The system as defined in Claim 16 further 
40 comprising means for designating one said block 

to be transmitted first in each of said groups. 

18. The system as defined in Claim 16 wherein 
said means for transmitting comprises means for 
transmitting said designated block first and them 

45 transmitting the remainder of said blocks in order 
of proximity to said designated block. 

19. The system as defined in Claim 16 wherein 
said means for transmitting comprises means for 
transmitting on a narrow band communications 

so channel. 

20. A system for transmitting an image repre- 
sented by digital data comprising: 

(a) means defining blocks to be transmitted, 
each of said blocks comprising digital data in pack- 

55 ets representing a portion of said image; 

(b) means for selectively establishing the 
order of transmission of said blocks; 

(c) means for selectively adjusting the 
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amount of digital data in each of said blocks; and 
(d) means for transmitting said blocks. 

21. The system as defined in Claim 20 further 
comprising means for selectively adjusting the 
compression of each of said blocks before trans- 
mitting said blocks. 

22. The system as defined in Claim 20 wherein 
said means for establishing the order of transmis- 
sion further comprises means for designating a first 
of said blocks to be transmitted and means for 
designating the order of transmission of the other 
said blocks based on proximity to said first block. 

23. The system as defined in Claim 20 further 
comprising a monitor means for indicating said 
blocks to be transmitted on said monitor, and 
means for indicating completion of transmission of 
said blocks on said monitor. 

24. The system as defined in Claim 20 further 
comprising: 

(a) means for providing first check sums for 
said packets of digital data to be transmitted; 

(b) means for transmitting said packets with 
corresponding said first check sums; 

(c) means for- receiving said packets and 
said check sums; 

(d) means for calculating second check 
sums for received said packets; 

(e) means for comparing corresponding said 
first and second check sums; 

(f) means for identifying said packets in 
which said first and second check sums are not the 
same; and 

(g) means for retransmitting only identified 
ones of said packets after said blocks, have been 
transmitted. 

25. The system as defined in Claim 20 wherein 
said means for transmitting comprises means for 
transmitting on a narrow band communication 
channel. 

26. A system for selectively transmitting one or 
more portions of a high resolution image depicted 
by digital data comprising: 

(a) means for establishing said image a ma- 
trix of blocks containing digital data; 

(b) means for selecting one or more interest 
centers on said image, wherein each said interest 
center comprises one of said blocks representing a 
focal point of a portion of said image to be trans- 
mitted; 

(c) means for selecting a group of said 
blocks proximate to and including one said interest 
center, wherein each said group represents a por- 
tion of said image to be transmitted; 

(d) means for selectively reducing the 
amount of digital data in each of said blocks to be 
transmitted; 

(e) means for selectively assigning an order 
of transmission for each said group; and 



(f) means for transmitting each said group, 
wherein said interest center is transmitted first in 
each said transmitted group and the remaining said 
blocks in each said transmitted group are transmit- 

s ted in order of proximity to said interest center. 

27. A system of transmitting and receiving digi- 
tal data representing an image comprising: 

(a) means for defining blocks of sard data 
representing portions of said image; 
10 <b) means for loading digital data from the 

defined blocks into packets of data to be transmit- 
ted; 

(c) means for providing first check sums for 
said packets of data; 
75 (d) means for transmitting said packets of 

data and said first check sums; 

(e) means for receiving said packets of data 
and said check sums without acknowledging re- 
ceipt until after each of said blocks is received; 
20 (f) means for calculating second check sums 

for received said packets of data; 

(g) means for comparing corresponding said 
first and second check sums; 

(h) first means for identifying said blocks of 
25 data in which corresponding said first and second 

check sums are the same for each of said packet 
therein; 

(i) second means for identifying said packets 
of data in which said first and second check sums 

30 are not the same; and 

Q) means for retransmitting said packets of 
data identified by second said means for identify- 
ing. 

35 
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© Prloritizized image transmission system and method. 



A system and method for processing and trans- 
mitting video imagery. The system permits the oper- 
ator of a video image system to selectively transmit 
desired portions of the video image at an operator 
selected resolution, operator selected compression 
level, and operator selected order of transmission of 
each of the portions. The system also includes a 
novel method of retransmitting only those packets of 
data which have been erroneously transmitted and 
an automated retransmission protocol which retrans- 
mits data in a more robust manner where errors are 
detected in the first transmission of the data. Also 
disclosed in the system is a method of shading 
various portions of the video image to inform the 
system operator of which portions of the video im- 
age have been transmitted and a protocol for limiting 
the duration of and for altering the frequency of data 
transmissions to avoid detection and/or jamming by 
others. 
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